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WHATIS CLAIMED IS: 



1 . A method for calibrating a three-dimensional imaging system the 
mefbod comprising: 

5 providing first and second measurement units, the first 

measurement unit configured to acquire infomiation from which 
locations of object features within a first meagiarement field can he 
deteomined in a first local coordinate system, the second 
measurement unit configured to acquire inforaiatign from which 
10 locations of object features within a second measurement field can 

be determined in a second local coordinate system; 

detemiining first locations in the first local coordinate 
system of a first plurality of calibration features located in the first 
measurement field, and, based on the first locations, determining 
15 locations in the first local coordinate system of a second pliiraUty 

of calibration features located in the second measurement field; 

determining locations of the second plurality of features in 
the second local coordinate system; and, 

deriving a transformation between the local coordinate 
20 systems and a common coordinate system based upon the locations 

of the second plurality of calibration features in the first and 
second local coordinate systems. 

2. The method of claim 1 wherein the first and second measurement 
25 fields overlap within an overlap region and the first and second 

pluralities of calibration features arc located within the overlap 
region. 
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3 . The method of claim 2 wherein the first and second pluralities of 
calibration features each comprise the same calihration featuics. 

4. The method of claim 1 wherein the first and second pluralities of 
5 calibration features are rigidly connected to one another. 

The method of claim 1 wherein determiniag the locations in the 
first local coordinate system of the second plurality of calibration 
features comprises determining locations of each of the first and 
second pluralities of calibration features relative to one another 
using one or more additional measurement units having 
measurement fields overlapping with the first and second 
measurement fields. 

15 6. A method for calibrating a finree-dimensional imaging system the 

method comprising: 

providing first and second measurement units, the first 

measurement unit configured to determine locations of object 

features within a jSrst measurement field in a first local coordinate 
20 systemj, tibie second measurement unit configured to determine 

locations of object features within a second measurement field in a 

second local coordinate system, the first and second measurement 

fields overlapping within an overlap region; 

determining locations of a plurality of calibration features 
25 located in the overlap region in each of the first md second local 

coordinate systems; 
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deii^dng a transformation between the local coordinate 
systems and a common coordinate system based upon the locations 
of the plurality of calibration fcatures. 

5 7. The method of claim 6 wherein the common coordinate system is 
the same as one of the first and second local coordinate systems. 

8 . The method of claim 6 wherein deriving a transformation between 
the local coordinate systems and a common coordinate system 

10 comprises performing an iterative process. 

9. The method of claim 8 wherein the iterative process comprises; 

obtaining an estimated transformation, 
applying the estimated transformation to the locations of the 
15 plurality of calibration features, 

deteraiining an eiror in the estimated transformation, 
determining a correction based on the error, and 
applying the correction to the estimated transforoiation. 

20 10. The method of claim 9 wherein the iterative process comprises 
peifomiing steps in a least-squares algorithm. 

1 1 . The method of claim 9 wherein the iterative process comprises 
applying different wcightmgs to different calibration features. 



25 



12, The method of claim 8 wherein ttie iterative process comprises: 
obtaining an estimated transformation; 
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correcting the estimated transformation; 

identifying one or more redundant calibration features for 
which the estimated transformation produces statistically outlying 
results; and, 

5 correcting the estimated transformation again without 

referrace to the one or more redundant calibration features, 

1 3. The method of claim 6 conqmsing; 
providing an additional measurement unit having a 

measurement field overlapping with one of ihe first end second 
measurement fields in an additional overlap region, the additional 
measurement unit configured to determine locations of object 
features within its measurement field m an additional local 
coordinate system; 

determining locations of a pliiralily of calibration features 
located in the additional overlap region in the additional local 
coordinate system; 

deriving a transformation between the additional locaj 
coordinate system aad a common coordinate system based upon 
the locations of the pluraHty of calibration features located in the 
additional overlap region. 

14. The method of cl aim 6 wherein determining locations of a plurality 
of calibration features comprises detentdning locations of a 

25 plurality of features of a known calibration obj cct. 



10 



15 



20 
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1 5. Tlie method of claim 6 wherein dcteimining locations of a plurality 
of calibration features comprises: 

deteimining a location of a calibration feature on a 
calibration object; 

moving the calibration object; 

detennining a new location of the calibration feature; and, 
repeating moving the calibration object and determining a 

new location of the calibration feature until a desired number of 

new locations has been detemuned. 



10 



if 1 6. The method of claim 6 comprising determining in the common 

coordinate system a location of a first object feature located in the 
m first measurement field and not located in the second measurement 

^ field and a location of a second object feature located in the second 

1 5 measurement field and not located in the first measurement field. 

2 17. The method of claim 6 wherein the calibration features comprise a 

feature of a calibration target con5)rising a spherical object. 



20 18, The method of claim 17 wherein detemrining locations of a 

plurality of calibration features comprises performing a circular 
Hough transform on image data fi:om a plurality of imaging 
devices. 



25 19. 



The method of claim 6 wherein the calibration features comprise a 
feature of a planar calibration target. 
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20. The method of claim 1 9 wherein the planar calihration target 
comprises a circular figure on a contrasting background. 

21, The method of claiin20 wherdn detennining locations of a 

5 plurality of calibration features comprises performing a drcular 

Hough transform on image data from a plurality of imaging 
devices. 

A method for calibrating a three-dimensional imaging system the 
method comprising: 

obtaining image data from a pluralily of itxnaging devices of 
a first stereo measurement unit, the imagii^ devices having fields 
of view that overlap in a first stereo measurement field; 

obtaining image data from a plurality of imaging devices of 
a second stereo measurement unit, the imaging devices having 
fields of view that overlap in a second stereo measurement field, 
the first and second stereo measurement fields overlapping one 
another in an overlap region containing at least one calibration 
target; 

determining thcee-dimensional characteristics of at least one 
calibration target relative to the first stereo measurement unit using 
image data obtained from the nnaging devices of the first stereo 
measurement unit; 

determining three-dimensional characteristics of at least one 
calibration target relative to the second stereo measurement unit 
using image data obtained from the imaging devices of the second 
stereo measurement imit; and, 



22. 



10 



15 



20 



25 
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deriving calibration parameters fromtte three-dimensional 
characteristics of the calibration targets relative to the first aiid 
second stereo measuTement units, the calibration parameters 
conqmsixig infoimation about a position and orientation of the first 
5 stereo measurement units relative to the second stereo 

measurement unit. 



23, A method according to claim 22 comprising deriving 

transfomiation functions based on the calibration parameters, the 
1 0 transfomiation functions providing a relationship between position 

data obtained from a pair of the imaging devices and a common 
coordinate system. 



24. A method according to claim 23, wherein determining the three- 
15 dimensional characteristics of at least cme calibration target 

comprises dcteraiining three-dimensional characteristics of a 
plurahty of calibration features. 



25. A method according to claim 23, wherein determining the three- 
20 dimensional characteristics of at least one calibration target 

con^rises determining three-dimensional characteristics of at least 
one of: circles, spheres, lines, and comers of a calibration object. 

26. A method according to claim 23, comprising measuring three- 
25 dimensional characteristics of an object located in any of the first 

stereo measurement field and the second stereo measurement field 
using the calibration parameters and using image data obtained 
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from at least two imaging devices selected from: the iimging 
devices of the first stereo measuremeut unit and the imaging 
devices of tiie second stereo measurement unit 

5 27, A method according to claim 23 , comprising: 

obtaining image data from a pl urality of imaging devices of 
each of one or more additional stereo measurement rniits, the 
imaging devices of each additional stereo measurement unit 
having fields of view that overlap one another in additional stereo 
10 measurement fields, at least one of the additional stereo 

measurement fields connected to at least one of the first and 
second stereo measurement fields by overlapping regions; and, 

deriving, from the image data obtained from the plurality of 
imaging devices of the additional stereo measurement units, 
15 calibration parameters comprising information about a position 

and orientation of each additional stereo measurement unit relative 
to a common coordinate system, 

28. A method according to claim 24, wherein dieriving each 
20 transformation function comprises starting with an estimated 

transformation function and then iteratively optimizing the 
transformation function to reduce differences between the three- 
dimensional characteristics of calibration targets in transformed 
image data and three-dimensional diaracteristics of the calibration 
25 targets in the common coordinate system. 
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29. A metfiod according to claim 28, wherein optimiziTig the 
transformation function comprises selectively weighing three- 
dimensional characteristics of some of the one or more calibration 
targets. 

5 

30. Apparatus for determining the locations of object features in three 
dimensions, the apparatus comprising: 



a first measurement unit configured to generate first data 
from which locations of object features in a first measurement field 



a second measurement unit configtrred to generate second 
data fi:om which locations of object features in a second 
measurement field can be detennmed in a second local coordinate 
system; and, 



10 



can be determined in a first local coordinate system; 



15 



a processor configured to: 

receive the first and second data; 

extract from the first data mformation about a first 



plurality of calibration features in tlie first measurement 



20 



field; and, 

based on the calibration infonnatian^ determine 



locations in the first local coordinate s>'stcm of a second 



plurality of calibration features in fhe second measuxenient 



field; 



determine firomthe second data locations of the 



25 



second plurality of calibration features in the second local 
coordinate systenu and, based on the locations of the second 
plurality of calibration features in the first and second local 



03/0S/D2 13:05 FAX 604 681 40S1 



OYEN WIGGS ET AL 



@]055 



-51- 

coordinate systems, generate a transformation which, when 
applied to the second data, expresses locations of object 
features in a conimon coordinate system. 

The apparatus of claim 30 wherein the first and second 
measurement fields o\^rlap in an overlap region and the second 
plurality of calibration features is in the overlap region. 

The apparatus of claim 30 wherein the first and second pluralities 
of calibration features each comprise the same calibration features. 

Apparatus for deteraiimng the locations of object features in three 
dimensions, the apparatus comprising: 

a first measmrement unit configured to generate first data 
fi"om which locations of object features in a first measurement field 
can be determined in a first local coordinate system; 

a second measurement unit configured to generate second 
data fiom which locations of object features in a second 
measurement field can be determined in a second local coordinate 
system, the second measurement unit located so that the first and 
second measurement fields overlap in an overlap region; and, 
a processor configured to: 

receive the first and second data; 
extract firom each of the first and second data 
25 cah~bration information about a plurality of calibration 

features of one or more calibration objects located in the 
overlap region; and, 



5 31. 



32. 

10 

33. 



15 



20 
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based on the calibration information, generate a 
transformation which, when applied to the second data 
expresses locations of object features in a common 
coordinate system. 

34- The apparatus of claim 33 wherein the first and second 

measurement fields have substantially parallel axes of symmetry. 



35. Theapparatusof claim 33 wherein the first and second 
M 1 0 measurement fields cross one atioth^ at an angle, 

^ 36. The apparatus of claim 33 wherein each of the measurement units 
ISi comprises two or more spaced-apart imaging devices and the 

J itnaging devices of each of the measurement units have fields of 

L 1 5 view which overlap with one another in tiie corresponding 

yj measurement field. 

^ 3 7. The apparatus of claim 3 6 wherein each of the imaging devices has 

an optical axis and the optical axes of the plurality of imaging 
20 devices are substantially parallel to one another. 

38. The apparatus of claim 33 wh^ein the processor is configured to 
perform a model-based recognition algorithm on the first and 
second data. 

25 
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39. The apparatus of claim 33 wherein the processor is configured to 
perfomi a circrular Hough transform on tihe first and second data to 
locate features of circular calibration targets. 

5 40. The apparatus of claim 33 comprising a plurality of additional 

measurement imits having corresponding additional measurement 
fields each connected to at least one of: the first measurement 
field, the second measurement field and another additional 
measurement field, by way of one or more overlapping regions. 

10 

4L Apparatus for deteonining the locations of object features in three 
dimensions, the apparatus comprising: 

a first stereo measurement unit comprising a plurality of 
imaging devices, the imaging devices having fields of view that 
1 5 overlap in a first stereo measurement field; 

a second stereo measurement unit comprising a plurality of 
imaging devices, the imaging devices having fields of view that 
overlap in a second stereo measurement field, the first and second 
stereo measurement fields overlapping one another in an overlap 
20 region; and, 

a processor, configured to: 

receive image data firan individual imaging devices in 
the first and second stereo measurement units; 

derive calibration parameters related to relative 
25 positions and orientations of the first and second stereo 

measurement imits, such that image data received from the 
first and second steieo vision units may be transformed to a 
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cominon reference coordinate system, using the calibration 
parameters, and, 

locate features of objects in the first or second stereo 
measnrement field in a common coordioate system using flic 
image data and liie calibration parameters. 

42, An apparatus according to claim 41 ^ wherciQ the imaging devices 
comprise at least one of: digital cameras^ analog cameras, acoustic 
sensors and laser range finders. 



43. An apparatas according to claim 4 1 , wherein the processor is one 
of: a computer executing a program; an embedded processor that is 
part of at least one of the first and second stereo measurement 
units and that is configured to execute instructions contained in 

15 memory accessible to the embedded processor; and a detachable 

processor that is attachable to, and detachable from, the first and 
second stereo measurement units and that is configured to execute 
instructions contained in memory accessible to the detachable 
processor. 

20 

44. An aEpparatus for determining locations of object features, the 
apparatus comprising: 

means for obtaining first data representing locations of 
object features in a first measurement field in a first local 
25 coordinate system; 
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means for obtaining second data representing locations of 
object features in a second measurement field in a second local 
coordinate system; 

means for locating in the first data a first plurality of 
5 calibration features in the first measui'emcnt field and dctcramung 

based on the first plurality of calibration features^ locations of a 
second plurality of calibration features in the second measurement 
field; 

means for locating in the second data the plurality of 
1 0 cahbration features; 

means for deterraining cahbration parameters based on the 
calibration features located in the first and second data; and, 

means for locating object features relative to a common 
coordinate system i^ing the calibration parameters. 

15 

45. The apparatus of claim 44 wherein the first and second 
measurement fields overlap in an overlap region. 

46i The apparatus of claim 44 wherein the means for determining 
20 calibration parameters comprises a means for deriving one or more 

transformation fimctions firom the first and second data. 

47. The apparatus of claim 45 wherein the transformation fimctions 
are adapted to provide as outputs the locations of object features in 
25 a common coordinate system when the traasformation functions 

are used in processing the first data or the second data or both the 
first and second data. 
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48- An apparatus accordmg to claim 46 wherein the first data 

comprises image data from two or more imaging devices and the 
apparatus camprises means for locating object features in the 
image data from each of two or more imaging devices and 
detemmring a position of the object features by triangulation. 

49, An apparatus according to claim 44 wherein the first and second 
data respectively comprise coordinates in the first and second local 
coordinate systems of points in a point cloud. 



5 0. Processing apparatus for use in deteraiining locations of obj ect 
features detected by one of a plurality of measuremeni: units, the 
processing apparatus comprising: 

an input for receiving first data from which locations of 
15 object features in a first measurement field can be determined in a 

first local coordinate system and second data from which locations 
of object features in a second measurement field can be detennined 
in a second local coordinate system, the first and second 
measurement fields overlapping in an overlap region; and, 
20 a processor coEnfigured to: 

^tract from each of the first and second data 
calibration information about a plurality of calibration features of 
one or more calibration objects located in the overlap region; and, 
based on the calibration information^ generate a 
25 transformation whichj when applied to the second data expresses 

locations of object features in a common coordinate system. 
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51. A nmchine readable mediiam carrying a set of instructions which, 
when executed by a data processor cause the data processor to 
perform a method for caliljrating a three-dimensional imaging 
system, con^sing: 

5 receiving first image data from a plurality of first imaging 

devices of a first measurement unit, the first imaging devices 
having fields of view that overlap in a first measuicment field and 
second image data from a plurahty of second imaging devices of a 
second measurement unit, the second imaging devices having 

10 fields of view that overlap in a second measnreament field, the first 

and second stereo measurement fields overlapping one anollier in 
an overlap region; 

locating a plurality of calibration features in each of the first 
and second image data; 

1 5 determining, from the locations in the first and second data 

of the calibration features, inforaiation characterizing a position 
and orientation of the second stereo measurement unit relative to 
the first stereo measurement unit 

20 52. A method of calilffating a three-dhncnsional imaging system 

comprising a plurality of measurement units each having a local 
coordinate system, the method conq)rising: 

a step for acquiring locations of a plurality of calibration 
features in a first local coordinate system of a first measurement 

25 unit; 
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a step for acquiring locations of the plurality of calibration 
featin:es in each of one or more additional local coordinate 
systems; and^ 

a step for creating a transformation from one or more of the 
local coordinate systems to a conmion coordinate system based on 
the locations of the pluralit>^ of calibration features in the first local 
coordinate system and the locations of the plurality of calibration 
features in at least one of the one or more additional local 
coordinate systems. 



53 . A method for calibrating a three-dimensional imaging system 
comprising: 

providing first and second measxrrement units, the first 
measurement unit configured to detemiine locations in a &st local 
15 coordinate system of object features within a first measurement 

field, the second measurement unit configured to detennine in a 
second local coordinate system locations of object features vnihin 
a second measurement field; 

determining locations of a jSrst plurality of calibration 
20 features in the first local coordinate system, the first plurality of 

calibration features located in die first measurement field; 

determining locations of a second plurality of calibration 
features in the second local coordinate system, the second plurality 
of calibration features located in the second measurement field, 
25 first plurality of features havii^ a fixed location relative to the 

second plurality of features; and* 
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deriving a transforaiation between the local coordinate 
systems and a conmon coordinate system based upon the locations 
of the first and second pluralities of calibration features. 

5 54. A method according to claim 53 , wherein said first and second 

stereo measurement fields overlap within an overlap region and the 
first and second pluralities of features are located in the overlap 
region. 

10 55- A method according to claim 54^ wherein determining locations of 
a first plurality of calibration features in the first local coordinate 
system also determines the locations of the second plurality of 
calibration features in the first local coordinate system. 



